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ABSTRACT 



The present invention uses three-state references to manage 
access to referenced objects. In a preferred embodiment, a 
pointer swizzling facility receives a request to swizzle a 
persistent pointer. In response to the request, the facility 
copies the persistent pointer to an indirection slot, and 
replaces the original persistent pointer with a smart pointer 
containing a pointer to the indirection slot. When the facility 
subsequently detects an attempt to dereference the smart 
pointer, the facility loads the referenced object using the 
persistent pointer stored in the indirection slot pointed to by 
the smart pointer. The facility further replaces the persistent 
pointer in the indirection slot with a pointer to the loaded 
referenced object. The facility also replaces the pointer to 
the indirection slot in the smart pointer with a pointer to the 
loaded dereferenced object Finally, the faciUty dereferences 
the pointer to the loaded referenced object in response to the 
attempt to dereference the smart pointer. 

20 Claims, 8 Drawing Sheets 
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USING THREE-STATE REFERENCES TO object server to the main memory of the computer system on 

MANAGE GARBAGE COLLECTION OF which the program is executing and performs a "depassiva- 

REFERENCED OBJECTS tion'' process. Depassivation involves replacing the persis- 
tent pointers in the transferred object, which cannot gener- 

CROSS-REFERENCE TO RELATED s ally be used by the program to access and modify the 

APPLI CATION referenced objects referred to by the persistent pointers, with 

main memory pointers that the program can use to access 

This application is a Continuation of pending U.S. patent and modify the referenced objects. Replacing a persistent 

application Ser. No. 08/764,557, filed Dec. 12, 1996, now pointer with a main memory pointer in this manner is called 

U.S. Pat. No. 5,794,256. "swizzhng" the persistent pointer. 

TPPHMirAT TTiFin Conventional swizzling techniques fall into three 

ItC^HNlCAL t\hlAJ categories, each of which has significant disadvantages. 

The present invention is related to the field of object Hardware swizzling uses the paging system of an existing 

references, and, more specifically, to the field of optimizing virtual memory management system to load referenced 

object references. 15 ^bj ects when main memory pointers to them are resolved by 

the program using the depassivated object. Virtual memory 

BACKGROUND OF THE INVENTION managers divide a main memory address space that is larger 

than actual main memory into pages of a fixed length. Some 

Some computer applications, such as CAD/CANM of the pages in the main memory space are actuaUy repre- 

applications, typically construct, taintain, access, and scntcd in the main memory, whfle others are "paged out." 

modify large set of data obj ects ("objects") over a substantial when a program attempts to dereference a pointer to a page 

period of time using a single computer system, or using a that Ls paged out, the attempt generates a hardware interrupt 

number of connected computer systems. It is common for called a "page fault." Page faults are handled by an interrupt 

such objects to contain references to other objects in the service routine that "pages in" the faulted page by finding 

object set. Such apphcaUons often use persistent object ^ room for it in main memory (in most cases by paging out 

systems to maintain these objects and make them available another page), loading the faulted page from disk into main 

for access and modification on any of the connected com- memory, marking the faulted page as paged in, and allowing 

puter systems. Persistent object systems ensure the continu- the dereferencing operation to proceed 

ing availabiUty of persistent objects by storing them in a According to the hardware swizzhng technique, when the 

non-vo atile manner in an object server, such as a database depassivated object is loaded, each persistent pointer is 

or a filesystem, while allowmg persistent objects to be ^^^^^^^ ^ ^ ^^^^^ ^ u^^^^ „ 

moved into a computer systems mam memory to be which is marked as paged out. When a program attempts to 

accessed and manipulated by programs executing on the dereference a main memory pointer to a ghost page, a page 

computer system. f^^j^ ^ generated, and a modified page fault interrupt 

When a program executing on a computer system finishes 35 handling routine loads the referenced object from the object 

accessing and modifying an object in its main memory, the server using its persistent pointer, marks the ghost page as 

persistent object system transfers the object to the object paged in, and allows the dereferencing operation to proceed, 

server to store the object in a non-volatile manner. The Subsequent attempts to dereference the main memory 

transferred object may contain references to other objects in pointer proceed without further delay. Hardware swizzling 

the object set. At the time of transfer, these references 40 has the advantage that referenced objects are not loaded until 

generally each comprise a pointer to an address in the main they are actually accessed. Hardware swizzhng also has two 

memory of the same computer system into which the important disadvantages, however: (1) Page fauUing and 

referenced object has been loaded. Such references depend paging in are expensive operations, taking roughly as much 

on both the identity of the computer system, which is not time as executing 2000 instructions on some processors. (2) 

reflected by the pointer, as well as the specific contents of the 45 The fixed page size used by virtual memory management 

main memory of the computer system, which may be . systems is ill-suited for storing variable-size objects— it 

completely different the next time a program transfers the causes a section of main memory larger than the loaded 

transfenrcd object from the object server. If the object server object to be devoted to the loaded object, and cannot 

later provides the version of the object containing main accommodate objects that grow in size over time to exceed 

memory pointers to a program on another computer system, 50 the size of the allocated pages. 

the main memory pointers in the object will be invaUd. As indirect software swizzling uses a memory location, 

part of the process of transfermg the object to the object called a "resident object descriptor** to provide a level of 

server, therefore, the persistent object system performs a indirection between a pointer in the depassivated object and 

process called "passivation." Passivation involves replacing the referenced object. Afer a depassivated object has been 

the mam memory pointer references m the passivated object 55 loaded, each persistent pointer in the depassivated object is 

used to locate the referenced objects in the main memory of moved to a resident object descriptor and replaced with a 

the cun-ent computer system with the persistent pointers pointer to the resident objea descriptor. Dereferencing the 

used by the persistent object system to locate the referenced pointers to a resident object descriptor for the first time 

objects m the object server. (Persistent pointers are also causes the referenced object to be loaded, and stores a main 

called "object identifier" (OIDs) and may be represented memory pointer to the loaded referenced object in the object 

using global unique identifier (GUID) data structures.) descriptor. The main memory pointer to the loaded refer- 

Replacmg a mam memory pointer with a persistent pointer cnced object in the resident object descriptor is then deref- 

m this manner is called ^'unswizzling*' the main memory erenced to provide access to the referenced object. When the 

pointer to a resident object descriptor is subsequently 

When a program later uses the persistent object system to 65 dereferenced, the main memory pointer to the loaded refer- 

access or modify the object transferred to the object server, enced object in the resident object descriptor is used to 

the persistent object system transfers the object from the access the referenced object. Like hardware swizzling, indi- 
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rect software swizzling has the advantage that referenced FIG. 2 is a flow diagram showing the steps preferably 

objects are not loaded until they are actually accessed. performed by the facility to load and depassivate a persistent 

Further, referenced objects may be unloaded or relocated object. 

without invalidating pointers to the resident object descrip- pi^^ 3 , ^ ^ ^^^^ ^^^^^^ 
tor stored m depassivated objects. Indirect software swiz- 5 performing step 201 

zlmg also has a sigmficant disadvantage, however: derefer- a - 

encing two main memory pointers (the first in the ^® * memory diagram showing the results of 

depassivated object, the second in the resident object performing steps 203 and 204. 

descriptor), which is required every time the program FIG, 5 is a flow diagram showing the steps preferably 

accesses the referenced object, has double the time cost of performed by the activity in response to an attempt by an 

dereferencing a single main memory pointer, or about the application program to dereference a smart pointer, 

same amount of time it takes to execute 90 instructions on piG. 6 is a memory diagram showing the results of 

some processors. performing the steps shown in FIG. 5. 

Direct software swizzhng involves replacing each persis- ^ ^^^^^ preferably performed by the 

tent pomter with a mam memory pomter directly to the r ■ . . ^ /. / f^i^^ii^^u 

referenced object. While this approach overcomes the extra f^^^^y o^^er to prepare an object for uoloadmg. 

time cost of double-indirection incurred by indirect software 8 is a memory diagram showing the results of 

swizzling, it has the disadvanUge that unloading or relocat- perfonning the steps shown in FIG. 7. 

. ing referenced objects invalidates the direct main memory FIG. 9 is a flow diagram showing the steps preferably 

pointers stored in depassivated objects. This can make performed by the facility in order to unload an object, 
efforts to relocate or reclaim memory from objects that are 20 piQ is a flow diagram showing the steps preferably 

referenced by depassivated objects difficult or impossible. performed by the facility in order to relocate an object in the 

Given the disadvantages of conventional swizzling main memory 

TaS^ateVX^^^^^^ 7^' ^ J ^ ^7 Rowing the steps preferably 

would have significant utility. 25 Pf,^^^^^^ ^^^^^y ^ "^^^^ ^o perform the wholesale 

^ idling process. 

SUMMARY OF THE INVENTION piQ. 12 is a flow diagram showing the steps preferably 

The present invention uses three-state references to man- performed by the facility in order to perform the flush 

age access to referenced objects. In a preferred embodiment, operation, 
in accordance with the invention, a persistent pointer sv^az- 

zling faciUty ("the facility*') replaces a persistent pointer, DETAILED DESCRIPTION OF THE 

usable to obtain a referenced object from the object server, INVENTION 

with a smart pointer. The smart pointer may either point t^,^ *i, ♦ ♦ r 

direcUy to the location in main memory at which the The present mvention uses three -state references to man 

referenced object has been loaded, or may point indirecUy to ^ referenced objects. In accord^ce with the 

the referenced object through an indirection slot. The facflity ^5 a persistent pointer swizzlmg facility ("the 

initially stores the persistent pointer for the referenced object faciht/) replaces, m a referencing object, a persistent 

in the indirection slot. When the smart pointer is first pointer to an unloaded referenced object with a smart pointer 

dereferenced, the smart pointer contains a pointer to the referenced object. 

indirection slot. At this point, the persistent pointer in the In a preferred embodiment, when the referencing object is 
indirection slot is used to load the referenced object into 40 loaded, the facility first moves the persistent pointer from the 

main memory from the object server. After the referenced referencing object to an indirection slot in a table of indi- 

object has been loaded, a pointer to the loaded object is rection slots, where it is stored with an indication that it is 

stored both in the indirection slot and in the smart pointer. a persistent pointer. The facility also at this point replaces the 

When the smart pointer is subsequently dereferenced, it persistent pointer in the referencing object with a smart 
contains a direct pointer to the loaded object, which is 45 pointer that contains a pointer to the indirection slot and that 

direcfly dereferenced to immediately access the referenced indicates that it does not contain a direct pointer to the 

object without using the indirection slot. referenced object. Smart pointers containing a pointer to the 

In order to "idle" the loaded referenced object, the facflity indirection slot are said to "indirecUy reference" the refer- 

replaces the direct pomter in the smart pointer with a pointer enced obiect 

to the indirection slot. When the loaded referenced object is ^, ' ^ 

intheidledstate,thefaciHtymayrelocateitinmainmemory ^ \^en the smart pointer m the referencing object is lat^^ 

without invalidating the smart pointer by merely adjusting dereferenced, the dereferencmg operation determmes that 

the pointer in the indirection slot. The facifity may also P^'^^^'' contained m the smart pointer is not a direct 

remove the referenced object from main memory when it is pomter to the referenced object, and uses it to access the 

in the idled state. When the facility removes the referenced persistent pointer in the central data structure. The facility 

object from main memory, it stores the persistent pointer for ^^^^ persistent pointer to load the referenced object into 

the referenced object in the indirection slot, so that a ™^ memory at a convenient address. The facility stores 

subsequent dereferencing of the smart pointer causes the address both in the reference in the referencing object 

referenced object to be reloaded. These features of the in the indirection slot, with indications that it is a direct 

facility are preferably used in a garbage-collection scheme pointer to the referenced object. Subsequent accesses to the 

for reclaiming unused memory, in which referenced objects referenced object proceed rapidly by immediately using the 

are idled when not recenUy used and made available for direct pointer stored in the referencing object, without 

removal from main memory. reloading the referenced object or accessing the slot table. If 

RRTPF nFsrRTPTTOM OF THP HRAWTMP^ ""^^^ referencing objects contain references to the same 

BRIEF DESCRIPTION OF THE DRAWINGS referenced objects, these, like the references to the refer- 
FIG. 1 is a high-level block diagram of the general- 65 enced object in the first referencing object, are replaced with 

purpose computer system upon which the facility preferably pointers to the same indirection slot. When these other 

operates. pointers to the indirection slot are dereferenced, the facility 



04/27/2004, EAST Version: 1.4.1 



6,105,041 



determines that the indirection slot contains a direct pointer 
to the loaded referenced object, and copies the direct pointer 
to the other referencing object to directly access the loaded 
referenced object without reloading it. 

When use of the referenced object concludes, the inven- 
tion preferably converts any smart pointers that directly 
reference the referenced object to indirectly reference the 
referenced object by replacing any direct pointers in refer- 
encing objects to the referenced object with pointers to the 
central data structure slot. This enables the referenced object 
to later be relocated in primary memory as necessary by 
merely updating the pointer in the central data structure slot 
without having to update any smart pointers in referencing 
objects. Also, referenced objects may be safely freed when 
none of the references to them are direct. Referenced objects 
may be freed in response to a request by another user of the 
referenced object to itself use the referenced object 
exclusively, or in response to an initiative to reclaim portions 
of memory occupied by unused objects. 

FIG. 1 is a high-level block diagram of the general- 
purpose computer system upon which the facihty preferably 
operates. The figure shows an object accessing computer 
system 100. The object accessing computer system 100 
contains a central processing unit (CPU) 110, input/output 
devices 120, and a main memory 130. Among the input/ 
output devices 120 is a storage device 121, such as a hard 
disk drive. The input/output devices 120 also include a 
network connection 122 that enables the object accessing 
computer system to exchange data with other computer 
systems. The input/output devices 120 further include a 
removable media drive 123, which can be used to install 
software products, including the facility, which are provided 
on a computer-readable medium, such as a CD-ROM. The 
main memory 130 contains a persistent object system 131 
for maintaining a set of objects persistently. The swizzling 
facility 132 is contained in the persistent object system 131, 
and executes on the CPU 110. The main memory 130 further 
includes a depa&sivated object 133, which contains a smart 
pointer 134. Tlie depassivated object 133 is also discussed 
herein as the referencing object. Ihe main memory 130 
further contains a slot table 135, which is made up of an 
indirection slot 136, as well as other indirection slots (not 
shown). The slot table preferably corresponds to a handle 
table utilized by the memory manager. At certain times, the 
main. memory 130 further contains a referenced object 137, 
as well as other referenced objects (not shown). 

FIG. 1 also shows that the network connection 122 of the 
object accessing computer system 100 is connected to a 
network connection 152 of an object server computer system 
150. The object server computer system 150 contains an 
object server 153, which maintains the set of persistent 
objects by storing them in a non-volatile manner. The object 
server 153 responds to requests from other parts of the 
persistent object system to transfer persistent objects in and 
out of the object server. The object server computer system 
150 also contains a processor 151 that is used by the object 
server 153. While the facility is preferably implemented on 
computer systems configured as described above, those 
skilled in the art will recognize that it may also be imple- 
mented on computer systems having different configura- 
tions. For example, the computer systems may not contain 
all of the features shown in FIG. 1, or may contain features 
not shown in FIG. 1. Further, the object server 153 may be 
located in the object accessing computer system 100 instead 
of the object server computer system 150. 

FIG. 2 is a flow diagram showing the steps preferably 
performed by the facility to load and depassivate a persistent 



object. The facility may load and depassivate a persistent 
object in response to a direct request from an apphcation. As 
is discussed below, the facility may also load and depassi- 
vate a persistent object in response to an attempt by an 

5 application to dereference a smart pointer to the persistent 
object. In step 201, the facility uses a persistent pointer for 
the persistent object to obtain the object from the object 
server 153 (FIG. 1) and store the object in the main memory 
130. The object loaded in step 201 may contain one or more 
pointers to other persistent objects. Such pointers to other 
objects are generally persistent pointers that may be used to 
obtain the objects referenced by them from the object server, 
as a result of the earlier passivation of the object loaded in 
step 201. Step 203 also preferably stores can indication in 
the indirection slot that the pointer in the indirection slot is 
a persistent pointer to the referenced object, not a main 
memory pointer dfrectly to the dereferenced object, 

FIG. 3 is a memory diagram showing the results of 
performing step 201. FIG. 3 shows the main memory 330, 

2Q as well as a portion of the contents of the main memory. 
Shown in the main memory are the referencing object 333 
loaded in step 201, and a slot table 335. The slot table 
contains a number of slots including slots 336, 341, 342, 
343, and 344. When loaded in step 201, the referencing 

25 object 333 contains one persistent pointer 371. 

Returning to FIG. 2, in steps 202-205, the facility depas- 
sivates the loaded object. The facihty loops through steps 
202-205 for each persistent pointer contained in the loaded 
object. In step 203, the facility assigns an indirection slot in 

30 the slot table 135 (FIG. 1) to the object referenced by the 
persistent pointer by copying the persistent pointer to an 
empty indirection slot in the slot table. 

FIG. 4 is a memory diagram showing the results of 
performing steps of 203 and 204. It can be seen from FIG. 

35 4 that the persistent pointer 371 (FIG. 3) has been copied 
from the referencing object 333 to an empty slot 436 of the 
slot table 435 in accordance with step 202. If an indirection 
slot in the slot table has already been assigned to the 
referenced object, however, the facility preferably does not 

40 assign another indirection slot to the referenced object in 
step 203. The facility preferably determines whether a slot in 
the slot table has already been assigned to the referenced 
object by maintaining an index on the slot table that maps 
from the persistent pointers of referenced objects to slots in 

45 the slot table assigned to those referenced objects. This 
index may be separate from the slot table, or may be 
integrated directly into the slot table. When the index 
indicates that an indirection slot in the slot table has not 
already been assigned to the referenced object and the 

50 facility assigns a slot in the slot table to the referenced 
object, the facility preferably also updates this index to 
include a mapping from the persistent pointer of the refer- 
enced object to the assigned slot. 

In step 204, the facHity replaces the persistent pointer in 

55 the loaded object with a smart pointer containing a pointer 
to the indirection slot for the referenced object. As part of 
step 204, the facility replaces a persistent pointer with a 
smart pointer and stores an indication in the smart pointer 
that the pointer contained by the smart pointer points to an 

60 indirection slot rather than pointing directly to the refer- 
enced object. It can be seen from FIG. 4 that, in step 204, the 
facility replaced the persistent pointer 371 in a referencing 
object 333 (FIG. 3) with a smart pointer 434. The smart 
pointer 434 includes a pointer to the slot 436, as well as an 

65 indication ("1") 462 that the pointer 461 contained by the 
smart pointer points to a slot rather than pointing directly to 
the referenced object. In order to make the length of the 
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smart pointer the same as the length of a main memory referenced object 637 in accordance with step 508. The 

pointer which the application expects to manipulate in the loaded referenced object 637 preferably contains its own 

depassivatcd object, the facility preferably stores this indi- persistent pointer 638, which can be used in conjunction 

cation as a bit in an unused bit position in the pointer to the with the slot table index that maps from persistent pointers 

indirection slot. Because of memory byte alignment s to indirection slots in order to locate the referenced object*s 

requirements, one or more of the least-significant bits of the slot in the slot table. The facility has further stored direct 

pointer to the indirection slot are xmused, as are the least- pointers to the referenced object 637 in the slot pointer 634 

significant bits of pointers to other objects. The facility and in the slot 636 formerly pointed to by the smart pointer 

therefore preferably stores the indication in the smart pointer 634. Further, because of byte alignment requirements for the 

in the least-significant bit of the main memory sorter con- jq location of the referenced object 637, the least-significant bit 

tained in the smart pointer. Those skilled in the art will of both the smart pointer 634 and slot 636 is "0," indicating 

appreciate that the indication could also be gainfully stored that these pointers are direct pointers to the referenced 

in a number of other ways. In step 205, the facility loops object. 

back to step 202 to process the next persistent pointer m the After the dereference operation shown in FIG. 5 has been 

loaded object. After step 205, these steps conclude. After the ^5 performed for a smart pointer, subsequent dereference 

facility loads and depassivates the object as shown in FIG. operations proceed quickly. Because the least-significant bit 

2, the application for which the object was loaded may of the smart pointer is "0,** the fadUty merely executes step 

access the object in the main memory, and, in particular, may 501 and 502 to return the referenced object 637 pointed to 

dereference smart pomters appearing in the object such as by the direct pointer 661 of the smart pointer 634. Because 

smart pointer 434 (FIG. 4). ^ this shortened process involves only a single access into the 

FIG. 5 is a flow diagram showing the steps preferably main memory, it is twice as fast as conventional indirect 

performed by the facility in response to an attempt by an software swizzhng techniques in which pointers to a refer- 

application program to dereference a smart pointer, liiese enced object are always indirected through another pointer, 

steps are preferably defined as the implementation of a In some cases, a referenced object must be unloaded from 

dereferencing operator for a class of which smart pointers 25 memory. Examples include when another application, pos- 

are each an instance. In the C++ programming language, a sibly on another computer system, needs to load the object 

template may be used to define the dereferencing operator with right access. Another example is when memory occu- 

for the smart pointer class to include these steps. pied by the object must be used for another purpose. In these 

In step 501, if a bitwise AND of the smart pointer with the situations, the facility can prepare the object for unloading 

value "1" is equal to 1 (i.e., the least-significant bit of the 30 in a way that does not invalidate any smart pointers to the 

smart pointer is "1," indicating that the smart pointer con- object held by apphcations and stored in other loaded, 

tains a pointer to a slot rather than a direct pointer to the depassivated objects. 

referenced object), then the facihty continues at step 503, FIG. 7 shows the steps preferably performed by the 

else the result of this bitwise AND is "0," indicating that the facihty in order to prepare an object for unloading. The 

pointer contained in the smart pointer is a direct pointer to 35 facihty also preferably executes these steps m order to 

the referenced object, and the facihty continues in step 502. prepare an object for relocation to another address within the 

In step 502, the facility returns the referenced object by main memory. Preparing an object before unloading or 

dereferencmg the direct pointer stored in the smart pointer relocation is known as "idling** the object. These steps 

using the standard pointer dereferencing operator. In step preferably identify the object to prepare for unloading by 

503, the facility changes the least-significant bit of the smart 40 identifying the indirection slot assigned to the object. In step 

pointer from 0 to 1. In step 504, if a bitwise AND of the 701-703, the facility loops through each smart pointer 

pointer m the slot pointed to by the slot pointer while the containing a direct pointer to the object to be idled which has 

value "1" is equal to "1" (i.e., the least-significant bit is equal the same value as the direct pointer through the object to be 

to "1," indicating that the pointer in the slot is a persistent idled stored in the identified slot. In a preferred embodiment, 

pointer rather than a direct pointer to the referenced object), 45 step 701 involves traversing a list of the smart pointers 

then the facihty continues m step 507, else the least- associated with the indireaion slot assigned to the object to 

significant bit of the pointer in the slot is a "0," and the be idled. This embodiment has a relatively low time cost, but 

pointer in the slot is a direct pointer to the referenced object, requires maintaming a list of the smart pointers associated 

and the facility continues in step 505. In step 505, the facility with each indirection slot. In an alternative embodiment, 

copies the direct pointer to the smart pointer from the slot 50 step 701 involves traversing lists of all of the smart pointers 

pointed to by the smart pointer. In step 506, the facility that have been created in the tnain memory. While the 

returns the referenced object by dereferencmg the direct alternative embodiment has the disadvantage that it has a 

pointer stored in the smart pomter using the standard pointer relatively large time cost, it has the advantage that it avoids 

dereferencmg operator. In step 507, the facihty changes the the storage and processing requirements of maintaining a list 

"1" in the least significant bit of the pointer in the slot ss of smart pointers for each indirection slot. In step 702, for 

pointed to by the smart pointer to a "0.'* In step 508, the each smart pointer containing a direct pointer to the object 

facility calls the persistent object system to obtain the to be idled, the facility stores a painter to the identified slot 

referenced object from the object server using the persistent in the smart pointer in place of the direct pointer. As part of 

pointer contained in the slot pointed to by the smart pomter. step 702, the facility aUo changes the least-significant bit of 

In step 508, the facihty further stores a direct pointer to the 60 the smart pointer to "1" to indicate that the smart pointer 

loaded referenced object in the slot pointed to by the slot now contains a pointer to an indirection slot rather than a 

pointer. After step 508, the facihty continues in step 505 to direct pointer to the referenced object. In step 703, the 

copy the direct pointer to the referenced object to the smart facihty loops back to step 701 to process the next smart 

pointer and return the referenced object. pointer containing a direct pointer to the object to be idled. 

FIG. 6 is a memory diagram showing the results of 65 After each such smart pointer has been processed, these 

performing the steps shown m FIG, 5, It can be seen by steps conclude. At the conclusion of these steps, there are no 

comparing FIG. 6 to FIG. 4 that the facility has loaded the smart pointers in the main memory containing direct point- 
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ers to the idled object. Rather, each smart pointer referring Some programming environments provide a feature 

to the idled object does so through the indirection slot. called garbage collection, which is a process that is periodi- 

FTG. 8 is a memory diagram showing the results of cally performed to identify and deallocate unused data 
performing the steps shown in FIG. 7. It can be seen by structures. In many such programning environments, the 
comparing FIG. 8 to FIG. 6 that the facility has replaced the s garbage collection feature is implemented using a "reach- 
direct pointer 661 in the smart pointer 634 (FIG. 6) with a ability algorithm," according to which pointers contained in 
pointer to the slot 836 for the referenced object. The facility objects known to be in use are recursively dereferenced in 
has further changed the least-significant bit of the smart order to access each data structure that may be directly or 
pointer to "1," indicating that the smart pointer contains a indirectly accessed through the data structures known to be 
pointer to an indirection slot rather than a direct pointer to in use. Any remaining data structures are assumed not to 
the referenced object. presently be in use and are deallocated. In programming 

FIG. 9 is a flow diagram showing the steps preferably enviromnents where this form of garbage collection is 

performed by the facility in order to unload an object In step employed, the facility preferably performs the wholesale 

901, the faciUty idles the indirection slot designed to the i^^ng process by idling each smart pointer encountered 

object to be unloaded as shown in FIG. 7. In step 902, the while recursively dereferencing pointers as part of the 

facility deallocates the portion of main memory occupied by garbage collection process, rather than performing the steps 

the object to be unloaded. In step 903, the facility replaces shown in FIG. 11. This enables the facility to avoid the cost 

the direct pointer in the indirection slot assigned to the object of maintaining the Ust of existing smart pointers utilized by 

to be unloaded with a persistent pointer to the object to be steps shown in FIG. 11. 

unloaded. These steps then conclude. If the smart pointer to In order to reclaim portions of the main memory occupied 

an unloaded object is later dereferenced, the facility uses the by loaded referenced objects that are not being accessed, the 

persistent pointer stored in the indirection slot to re-retrieve facility preferably performs a flush operation a predeter- 

the unloaded object from the object server. mined period of time after it performs the wholesale idling 

After the facility performs the steps shown in FIG. 9 to operation. In flie flush operation, objects that are still idle 

unload the object, the main memory is retumed to the after a period of time has passed since wholesale idling are 
condition shown in FIG. 4. Namely, the smart pointer 434 25 considered unused and are unloaded. FIG. 12 is a flow 

contains a pointer 461 to the indirection slot 436 assigned to diagram showing the steps preferably performed by the 

the unloaded object. The indirection slot 436 contains a facility in order to perform the flush operation. In steps 

persistent pointer to the referenced object that the facility 1201-1203, the facility loops through each smart pointer in 

can use to reload the referenced object is smart pointer 461 ^se- 1° step 1202, if the slot is still idle, meaning that none 
is later dereferenced. 3q of the smart pointers contain direct pointers to the referenced 

The facility also provides for the relocation of referenced ^^i^^^ "^^^^^ the slot is assigned, then the faciUty con- 
objects while loaded into the main memory. FIG. 10 is a flow ^nu&s in step 1204 to unload the object which the slot is 
diagram showing the steps preferably performed by the assigned. After steps 1202 are 1204, the facility continues in 
facility in order to relocate an object in the main memory. In ^^^P ^ ^°°P ^^^^ ^^^P ^^^^ process the next used 
step 1001, the facility idles the slot assigned to the object to 35 ^^"^ ^^^^^ ^^P« conclude, 
be relocated as shown in FIG, 7. In step 1002, the facflity ^ ^^^^^ present mvention has been shown and 
relocates the referenced object in main memory by copying ^escrftjed wiUi reference to preferred embodiments, it will 
it to another location in main memory and returning the beundei^toodby flioseskdledinthe artthat vanouschap^ 

memory originally containing the referenced object to the LT^f^c'ftn^^^^^ I" ^'^T 

i„lZ«inni *u f r* . • *u i * ■ j departing from the scope of the invention. For example, the 

t ^ rllt T/ 1 / ^ TT 1 ""l^^f e^^^^g^ ^^^l^^tion and flush operations may be perform^! in 

to the relocated object a direct pointer to the °ew location to , ^^.^ ^^^^^^^ manners that each resdt in the unload- 

which the referenced object was moved in step 1002. Tliese of unused referenced objects. For example, flie facility 

steps then conclude. uiay maintain a list of the objects sorted by the time of their 

The facility preferably performs, at various times, a last idling, and periodically unload the objects that were last 
process of idling all of the objects referenced by slot 45 idled the earliest. Also, the smart pointers and indirection 

pointers. This process is termed "wholesale idling," and slots may use other indications of whether they contain a 

aflows the facility to track smart pointers that are not being direct pointer to the referenced object than stored as "0" in 

dereferenced frequently in that, after a significant period of the least-significant bit of the pointer. For example, the 

time has passed since wholesale idling, slots that are still idle facility may store these indications as flags separate from the 
correspond to smart pointers that have not been dereferenced 50 pointer, 

since the wholesale idling process was performed. We claim: 

FIG. 11 is a flow diagram showing the steps preferably 1. Amethodin a computer system for performing garbage 

performed by the facility in order to perform the wholesale collection 00 a group of smart pointers, smart pointers 

idling process. In steps 1101-1104, the facihty loops through containing either a direct pointer to a loaded object or a 
each existing smart pointer. This loop preferably involves 55 pointer to an indirection slot for containing pointer indirec- 

traversing a fist of existing smart pointers that is updated lion information, the method comprising the steps of: 

when smart pointers are created or destroyed. In step 1102, identifying smart pointers in the group of smart pointers 

if the smart pointer contains a direct pointer to the referenced containing a direct pointer to a loaded object; and 

object as indicated by its least-significant bit, then the for each identified smart pointer: 

facility continues at step 1103, else the facility continues at 60 identifying an indirection slot containing a direct 

step 1104. Iq step 1103, the facility stores in the smart pointer to the same loaded object to which the direct 

pointer an indirect pointer to the referenced object, com- pointer in the smart pointer points, and 

prising the address of the slot assigned to the referenced replacing the direct pointer in the smart pointer with a 

object with its least-significant bit changed to "1." In step pointer to the identified indirection slot. 

1104, the facihty loops back to step 1101 to process the next 65 2. The method of claim 1 wherein the steps are performed 

smart pointer. When no smart pointers remain, these steps in response to committing changes to the objects to a 

conclude. persistent object store. 
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3. Hie method of claim 1, further including the steps of, 
in response to a request to reclaim memory: 

identifying objects not pointed to by any direct pointer io 

any smart pointer; and 
for each identified object: 

identifying an indirection slot containing a direct 

pointer to the identified object, 
unloading the identified object, and 
replacing the direct pointer in the identified indirection 
slot with a reloading identifier usable to reload the 
identified object. 

4. The method of claim 1, further including the steps of, 
in response to a request to reclaim memory: 

identifying indirection slots containing a direct pointer to 
an object that is not contained in any smart pointer; and 
for each identified indirection slot: 

unloading the object pointed to by the direct pointer in 

the indirection slot, and 
replacing the direct pointer in the indirection slot with 
a reloading identifier usable to reload the unloaded 
object. 

5. A computer-readable medium whose contents cause a 
computer system to perform garbage collection on a group 
of smart pointers, smart pointers containing either a direct 
pointer to a loaded object or a pointer to an indirection slot, 
by performing the steps of: 

identifying smart pointers in the group of smart pointers 

containing a direct pointer to a loaded object; and 
for each identified smart pointer: 

identifying an indirection slot containing a direct 
pointer to the same loaded object to which the direct 
pointer in the smart pointer points, and 
replacing the direct pointer in the smart pointer with a 
pointer to the identified indirection slot. 

6. The computer-readable medium of claim 5 wherein the 
steps are performed in response to committing changes to 
the objects to a persistent object store. 

7. Tlie computer-readable medium of claim 5 wherein the 
contents of the computer-readable medium further cause the 
computer system to perform the steps of, in response to a 
request to reclaim memory: 

identifying objects not pointed to by any direct pointer in 

any smart pointer; and 
for each identified object: 

identifying an indirection slot containing a direct 

pointer to the identified object, 
unloading the identified object, and 
replacing the direct pointer in the identified indirection 
slot with a reloading identifier usable to reload the 
identified object. 

8. The method of claim 5, further comprising the steps of: 
after the moving and replacing steps, detecting an invo- 
cation of a dereferencing operation on the smart 
pointer; and 

in response to the detecting step: 

replacing the pointer to the indirection slot in the smart 

pointer with the pointer to the new memory location 

in the indirection slot, and 
dereferencing the pointer to the new memory location. 

9. A method in a computer system having a main memory 
for idhng a referenced object stored in the main memory and 
referred to by one or more smart pointers using an indirec- 
tion slot containing a main memory pointer to the referenced 
object, the method comprising the steps of: 

receiving a request to idle the referenced object by 
ensuring that no smart pointers contain a direct pointer 
to the referenced object; and 
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in response to the receiving step, for each smart pointer 
referring to the referenced object, storing in the smart 
pointer a pointer to the indirection slot. 

10. The method of claim 9, further comprising the steps 

s of: 

detecting an attempt to dereference the smart pointer; and 
in response to the detecting step: 
replacing the pointer to the indirection slot in the smart 
pointer with the pointer to the referenced object, and 
dereferencing the pointer to the loaded referenced 
object. 

11. The method of claim 9, further comprising the steps 

of: 

after the storing step, receiving a request to unload the 
referenced object from the main memory; and 

in response to the step of receiving a request to unload the 
referenced object: 

replacing the main memory pointer to the referenced 
20 object contained by the indirection slot with a per- 

sistent pointer usable to reload the referenced object, 
and 

unloading the referenced object. 

12. The method of claim 11, further comprising the steps 

25 

detecting an attempt to dereference the smart pointer; and 
in response to the detecting step: 
loading into the main memory the referenced object 
using the persistent pointer stored in the indirection 
30 slot, 

replacing the persistent pointer in the indirection slot 

with a pointer to the loaded referenced object, 
replacing the pointer to the indirection slot in the smart 
pointer with the pointer to the loaded referenced 
object, and 

dereferencing the pointer to the loaded referenced 
object. 

13. The method of claim 9, further comprising the steps 

of: 

^° after the storing step, receiving a request to reposition the 
referenced object to a new memory location; and 
in response to the step of receiving a request to unload the 
referenced object: 
^2 using the pointer in the redirection slot to move the 
referenced object to the new memory location, and 
replacing the main memory pointer to the referenced 
object contained by the indirection slot with a main 
memory pointer to the new memory location. 

14. A method in a computer system for using a smart 
pointer to access a target object, the smart pointer containing 
a pointer to an indirection slot, the indirection slot contain- 
ing an object identifier usable to retrieve the target object, 
the method comprising the steps of: 

55 detecting an attempt to dereference the smart pointer; and 
in response to the detecting step: 
retrieving the referenced object using the object iden- 
tifier stored in the indirection slot, 
replacing the object identifier in the indirection slot 
60 with a pointer to the retrieved referenced object, 

replacing the pointer to the indirection slot in the smart 
pointer with the pointer to the retrieved referenced 
object, and 

dereferencing the pointer to the retrieved referenced 
65 object. 

15. A computer-readable medium whose contents cause a 
computer system to use a smart pointer to access a target 
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object, the smart pointer containing a pointer to an indirec- 
tion slot, the indirection slot containing an object identifier 
usable to retrieve the target object, by performing the steps 
of: 

detecting an attempt to dereference the smart pointer; and 
in response to the detecting step: 
retrieving the referenced object using the object iden- 
tifier stored in the indirection slot, 
replacing the object identifier in the indirection slot 

with a pointer to the retrieved referenced object, 
replacing the pointer to the indirection slot in the smart 
pointer with the pointer to the retrieved referenced 
object, and 

dereferencing the pointer to the retrieved referenced 
object. 

16. A method in a computer system for using a smart 
pointer to access a target object, the smart pointer containing 
a pointer to an indirection slot, the indirection slot contain- 
ing a pointer to the target object, the method comprising the 
steps of: 

detecting an attempt to dereference the smart pointer; and 
in response to the detecting step: 

replacing the pointer to the indirection slot in the smart 
pointer with the pointer to the target object, and 

dereferencing the pointer to the target object. 

17. A computer-readable medium whose contents cause a 
computer system to use a smart pointer to access a target 
object, the smart pointer containing a pointer to an indirec- 
tion slot, the indirection slot containing a pointer to the target 30 
object, by performing the steps of: 

detecting an attempt to dereference the smart pointer; and 
in response to the detecting step: 

replacing the pointer to the indirection slot in the smart 
pointer with the pointer to the target object, and 

dereferencing the pointer to the target object. 

18. Amain memory coQtainiog a swizzled reference data 
structure capable of representing a reference to a referenced 
object either as a direct pointer containing an indication of 



if the indication of whether the swizzled reference data 
structure represents a reference to a referenced object 
as a direct pointer or as an indirect pointer indicates that 
the swizzled reference data structure represents a ref- 
erence to a referenced object as a direct pointer, a direct 
pointer containing an indication of the location of the 
object in the main memory; and 
if the indication of whether the swizzled reference data 
structure represents a reference to a referenced object 
as a direct pointer or as an indirect pointer indicates that 
the swizzled reference data structure represents a ref- 
erence to a referenced object as an indirect pointer, an 
indirect pointer containing an indication of the location 
of a direct pointer that itself contains an indication of 
the location of the object in the main memory, 
such that, if the indication of whether the swizzled reference 
data structure represents a reference to a referenced object as 
a direct pointer or as an indirect pointer indicates that the 
swizzled reference data structure represents a reference to a 
referenced object as a direct pointer, the direct pointer of the 
swizzled reference data structure can be dereferenced to 
access the object in the main memory, and such that, if the 
indication of whether the swizzled reference data structure 
represents a reference to a referenced object as a direct 
^5 pointer or as an indirect pointer indicates that the swizzled 
reference data structure represents a reference to a refer- 
enced object as an indirect pointer, the indirect pointer of the 
swizzled reference data structure can be dereferenced to 
access the direct pointer, which in turn may be dereferenced 
to access the object in the main memory. 

19. The main memory of claim 18 wherein indications of 
the location of data in main memory have a predetermined 
size, and wherein the swizzled reference data structure also 
has the predetermined size. 

20. The main memory of claim 18 wherein a least one bit 
of both the indication of the location of the object in the main 
memory and the location of a direct pointer that itself 
contains an indication of the location of the object in the 
main memory is unused, and wherein the indication of 
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the location of the object in the main memory, or as an whether the swizzled reference data structure represents a 

_ - . . _ _ _ reference to a referenced object as a direct pointer or as an 

indirect pointer is stored in the imiised bit of the indication 
of the location of the object in the main memory or the 
location of a direct pointer that itself contains an indication 
of the location of the object in the main memory. 



indirect pointer containing an indication of the location of a 
direct pointer that itself contains an indication of the location 
of the object in the main memory, the swizzled reference 
data structure comprising: 

an indication of whether the swizzled reference data 
structure represents a reference to a referenced object 
as a direct pointer or as an indirect pointer; 
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